The diagnostic performance evaluation of Panbio and STANDARD Q coronavirus disease 2019 antigen tests against real-time polymerase chain reaction in southern Ethiopia

The coronavirus disease 2019 (COVID-19) pandemic has created a public health crisis. This study aimed to evaluate the diagnostic performance of the Panbio and STANDARD Q COVID-19 antigen rapid diagnostic tests (RDTs) against the real-time polymerase chain reaction (RT-PCR) at one of the largest hospitals in southern Ethiopia. Nasopharyngeal samples, which were collected during the pandemic from individuals suspected of COVID-19 and stored at − 70 °C, were analyzed in June and July 2022. The performance of the Panbio COVID-19 antigen tests was evaluated in 200 randomly selected nasopharyngeal samples (100 positives and 100 negatives for severe acute respiratory syndrome 2 by RT-PCR). The STANDARD Q test was evaluated using 100 positive and 50 negative samples. The respective sensitivity, specificity, positive predictive value and negative predictive values were 88%, 99%, 98.9% and 89.2% for the Panbio test and 91%, 98%, 98.9% and 84.5%, for the STANDARD Q test. The kappa values were 0.87 for the Panbio and 0.86 for the STANDARD Q test. Based on the findings presented here, the RDTs could be utilized as an alternative to conventional RT-PCR when it is challenging to diagnose COVID-19 owing to a lack of time, skilled lab personnel, or suitable equipment or electricity.

cassette-based format with a visual read-out 7 .These RDTs are simple to use and interpret, do not require highly skilled personnel or a laboratory setup, and yield results in less than 30 min, all of which reduce procedure costs and strengthen public health responses 8 .The necessity of thorough evaluations across several geographic locations must be emphasized since the test performance for such products is impacted by variables like investigated population and genetic diversity of causative organisms.However, limited evidence exists regarding the diagnostic usefulness of this product in Ethiopian contexts.Therefore, this study aimed to evaluate the diagnostic performance of Panbio and STANDARD Q COVID-19 RDTs against the RT-PCR from stored samples in southern Ethiopia.

Study setting and samples
The study was conducted at the COVID-19 Testing Centre of Hawassa University Comprehensive Specialized Hospital (HUCSH) in Hawassa City, southern Ethiopia.During the pandemic, there was one quarantine, two isolation, and two treatment centres in Hawassa.The COVID-19 treatment centre at HUCSH is one of the first facilities in the country to offer care services to patients with confirmed COVID-19 9 .It has 100 beds total, including six beds in the intensive care unit, four of which have mechanical ventilation.Trained staff in the hospital have been working to reduce the impacts of the COVID-19 pandemic since the outbreak began in Ethiopia by raising community awareness creation, providing quarantine and treatment services, and conducting COVID-19 research projects.Individuals suspected of COVID-19 were routinely screened for SARS-CoV-2 using RT-PCR.A 5% of the SARS-CoV-2 negative and all positive nasopharyngeal samples were stored at − 70 °C for research purposes.Nasopharyngeal samples, which were collected and stored after being tested for SARS-COV-2 from January 10 to May 30, 2022, were considered for the current analysis.The performance of the Panbio COVID-19 antigen tests was evaluated from June 1 to July 30, 2022, in 200 randomly selected nasopharyngeal samples (100 positives and 100 negatives for SARS-CoV-2) by lottery method.The STANDARD Q test was evaluated using 100 positive samples; however, due to the shortage of test kits, we only tested 50 negative samples, which were also chosen by lottery out of 100 negative samples.Samples with inadequate volume or incomplete labelling, those with invalid or indefinite results by RT-PCR, and those with incomplete patient records were excluded.The flow chart of enrollment of samples is presented in Fig. 1.

Record review
The socio-demographic (age and gender) and clinical data were collected by reviewing the COVID-19 registration book for each participant including the number of days post-symptom onset, type of symptoms and chronic diseases using a data collection checklist.The following symptoms were recorded: cough, fever, back pain, sore throat, loss of smell, loss of taste, fatigue, and shortness of breath.Patients' status for having chronic diseases such as hypertension, diabetes, tuberculosis, asthma, human immunodeficiency virus (HIV), chronic cardiac disease, and chronic kidney disease were also recorded.

Sample collection, transportation, and storage
The initial collection and storage of the nasopharyngeal samples utilised in the current investigation was done as follows.The collection of nasopharyngeal swabs from patients suspected of having SARS-CoV-2 infection was routinely done by trained healthcare professionals, following the proper infection control procedures and using the recommended personal protective equipment.The collected swabs were kept in a viral transport medium containing 3 ml fluid composed of gelatin and antimicrobial agents in a buffered salt solution.The specimens were transferred to the laboratory by maintaining a cold chain (2-4 °C).All samples were analyzed by using RT-PCR (Veri-Q PCR 316 assay, MiCo BioMed.Co., Ltd., Korea), and results were released for clinical management as soon as possible.All SARS-CoV-2-positive and 5% negative samples were stored at − 70 °C.For this performance evaluation, stored nasopharyngeal samples were re-tested using Veri-Q PCR 316 assay to confirm results.

SARS-COV-2 RNA extraction
Nucleic acid extraction was done by a trained laboratory technologist under biosafety level 2 (BSL-2) using the BIOER system (GenePure Pro fully automatic Nucleic Acid Purification System; Hangzhou Bioer Technology Co., Ltd., China), according to the manufacturer's instructions.The extraction procedure took only 15 min to extract the SARS-CoV-2 ribonucleic acid (RNA) from a 300 µl nasopharyngeal specimen.In a single run, the system could be able to give us 32 extracts of the SARS-CoV-2 RNA.Then, the extract was transported to the room devoted to the master mix preparation and amplification.

SARS-COV-2 RNA detection
In the master mix preparation and amplification room, 63 μl of the reaction mix was prepared under the BSL-2 from 45 μl 2X One-Step RT-PCR master mix, 9 μl of COVID-19 primer and probe, and 9 μl internal positive control.Immediately after the preparation, a 7 μl of the mix was applied to the Eppendorf tubes each containing 3 μl of the SARS-CoV-2 RNA extract.A 10 μl of the reaction was applied to the lab chip by using a pipette and loaded into the RT-PCR for the amplification.The Veri-Q PCR 316 assay, designed for the qualitative detection of the open reading frame (ORF3a) and nucleocapsid (N) genes of SARS-CoV-2 RNA from nasopharyngeal swabs, was used to carry out the RT-PCR amplification.A positive control template and negative amplification control with nuclease-free water were included in each run.In the one-step reaction, the reverse transcription, which

Rapid diagnostic tests
The Panbio COVID-19 antigen test device (Abbott Diagnostic GmbH, Jena, Germany) and the STANDARD Q COVID-19 antigen test (SD Biosensor, Korea) are an in vitro diagnostic rapid test that employs the lateral flow assay principle for the qualitative detection of SARS-CoV-2 antigen in nasopharyngeal swab specimens.The anti-SARS-CoV-2 antibody is conjugated with colour particles and is used as a detector for the SARS-CoV-2 antigen.The test procedures for both RDTs involve mixing using a vortex mixer for 10 s to disrupt thick mucus.For the Panbio test, 5 drops of samples are applied to the sample pad of the cassette, and results are read within 15-20 min of incubation.For the STANDARD Q test, 3 drops of samples are applied to the sample pad of the cassette and results are read within 15-30 min of incubation.A positive test result is indicated when control (C) and test lines are visible, and a negative result is when only control line (C) is visible.The test is invalid when the control line is invisible.Personnel, who perform RDTs and RT-PCR tests, were blinded to any demographic, Vol:.( 1234567890)

Data analysis
Data were double-entered into Epidata version 4.6 and exported to SPSS version 25 (IBM Corp, Inc., New York, USA) for analysis.Frequencies and percentages were used for the description of the qualitative data.All continuous data were expressed as median and interquartile range (IQR).The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated to determine the diagnostic performance of the RDTs, considering the RT-PCR as a reference method.Cohen's Kappa index was computed to test the level of agreement.The confidence intervals (CI) were calculated using the GraphPad Prism version 9.5.1 for Windows (GraphPad Software, San Diego, California USA).

Ethical clearance
The Institutional Review Board (IRB) of Hawassa University College of Medicine and Health Sciences evaluated and approved our study (Reference Number IRB/162/14), and informed consent was waived.We confirm that all methods were performed in accordance with the relevant guidelines and regulations.Code numbers were used in place of identifiers to ensure the confidentiality of collected information and blind the investigators to prior test results or participants' demographic and clinical information.

Participants' demographic and clinical characteristics
A total of 200 stored nasopharyngeal samples (100 SARS-CoV-2 positives and 100 negatives), which were initially collected for routine available care, were analyzed in the present study from June 1 to July 30, 2022.The participants' ages ranged from 1 to 85 years, with the median (IQR) age being 26 (13-38) years.More than half of the participants, 114 (57.0%), were males, and 86 (43.0%) were females.The majority of the participants, 163 (81.5%), were symptomatic as they showed at least one of the symptoms.Fever, 121 (60.5%), is the symptom most frequently reported in the patients included in the study, followed by cough, 90 (45.0%).The most frequently reported chronic disease among the participants was hypertension, 35 (17.5%), followed by diabetes mellitus, 27 (13.5%),and tuberculosis, 23 (11.5%) (Table 1).

RDTs results in relation to RT-PCR
The diagnostic performance results of the RDTs compared with the RT-PCR are shown in Table 2.The Panbio COVID-19 antigen test detected the SARS-CoV-2 antigens in 89 samples; of which, 88 samples had also positive results by the reference method.Moreover, 99 negative results were concordant with the RT-PCR, yielding an accuracy of 93.5% for the detection of SARS-CoV-2 infection.Also, the STANDARD Q COVID-19 antigen test detected the SARS-CoV-2 antigens in 92 samples; of which, 91 samples had also positive results by the reference method.Moreover, 49 negative results out of 50 were concordant with the RT-PCR, yielding an accuracy of 93.3% for the detection of SARS-CoV-2 infection.Twelve and nine false negative test results were observed for the Panbio and the STANDARD Q, respectively, while only one false positive result was observed for both RDTs.

RDTs performance by age, clinical characteristics, and CT values
Table 3 shows the performance of the Ag-RDTs according to the presence of signs/symptoms, age, CT value, and presence or absence of chronic diseases.The higher performance of the test was observed for CT < 25, for which the sensitivity was 93.9% for the Panbio and 100% for STANDARD Q; and for age ≥ 18 years, the sensitivity was 98.6% for both RDTs.Regarding chronic disease, comparable sensitivities were observed.For patients visiting within 3 days post symptom onset, the sensitivity of both RDTs was 96.3% (n = 77).For those presenting on or after 8 days post symptom onset, the sensitivity was 64.3% for STANDARD Q and 35.7% for the Panbio (Table 4).

Discussion
The pandemic response depends heavily on improving diagnostic access to SARS-CoV-2 detection in COVID-19-suspected people.Thus, developing accurate methods for the prompt detection of SARS-CoV-2 is crucial.We evaluated the performance of the Panbio and the STANDARD Q COVID-19 antigen tests relative to the RT-PCR for the diagnosis of SARS-CoV-2.It is due to the need to find a reliable point-of-care test, which could effectively reduce the burden of specimen referral logistics and contribute to improved diagnostic coverage in resource-limited areas.The respective sensitivity and specificity were 88.0% and 99.0% for the Panbio and 91.0% and 98.0% for the STANDARD Q.The positive predictive value for both RDTs was 98.9%, while the negative predictive values were 89.2% and 84.5% for the Panbio and STANDARD Q, respectively.
The performance demonstrated in our study was in line with the previous studies 10,11 .However, our findings indicated lower sensitivities compared to reports from Thailand (98.3%) 7 and Korea (94.9%) 12 for the STANDARD Q; and from Ethiopia (95%) for Panbio 13 .Possible explanations for the relatively lower sensitivities in our study might be associated with the lower viral loads in our study participants.On the other hand, our www.nature.com/scientificreports/results were higher than the sensitivities reported for the STANDARD Q (17.5-70.6%) 6,14,15, and for the Panbio (41.3-81.0%) 11,16,17.This might be due to the factors that influence the performance of Ag-RDTs, such as the type and quality of the specimen, collecting and processing techniques, and the transportation and storage conditions.Regarding viral load, both RDTs were shown to have higher sensitivities in samples with lower cycle thresholds (CT value < 25) compared to those with higher ones (CT value ≥ 25).This finding was in agreement with results reported in the Netherlands 16 , Korea 12 , and Spain 18 .Similar results have been found by other research in samples with low CT values due to high virus loads 11,13,19,20 .This might suggest that an elevated viral load, which is connected to viral infectivity, is indicated by a positive antigen test 21 .
Moreover, a higher sensitivity of 98.6% (95% CI 92.4-100%) was shown for both Panbio and STANDARD Q among participants aged 18 years and above compared to those aged less than 18 years, as reported by other studies 20,22 .However, no age-related difference was observed in SARS-CoV-2 viral loads between children and   We also provided data showing that the likelihood of positive Ag-RDT results matched with the early onset of symptoms, consistent with the findings of other studies 10,15,19,23 .It was observed that the sensitivities of the RDTs were higher in participants with ≤ 7 days post-symptom onset compared to those with the onset > 7 days, which might be due to reduced antigen concentrations in samples from participants with late-stage symptoms.Moreover, participants with symptoms > 7 days were more likely to have lower viral loads in nasopharyngeal swabs than those who were tested at an early stage after the onset of symptoms.
Our findings of high specificities of the RDTs were in line with other similar research results (97.6-100%) 4,11,20 .It might imply that rapid antigen tests have a very low likelihood of producing false positive results and that a subject who receives a negative test is very likely to be negative for SARS-CoV-2.However, a report of a lower specificity for STANDARD Q (81%) 7 compared to our result, may be caused by cross-reacting antibodies from prior infections or the test's performance being impacted by the environmental conditions under which the test was performed.
Diagnostic tests with a high positive predictive value would be essential to assist efforts in reducing the risk of transmission of infection 9 .Both of the Ag-RDTs used in this study had positive predictive values of 98.9%, indicating that individuals who test positive via the Ag-RDTs are very likely to be infected with the SARS-CoV-2 virus.Thus, the use of Ag-RDTs might make diagnostics more accessible, especially in countries with limited resources, and make it easier to undertake mass screening for COVID-19.
To our knowledge, this is the first study evaluating the Panbio and STANDARD Q COVID-19 antigen tests against RT-PCR, providing insight into the performance characteristics of these kits and enabling evidence-based decisions for their potential use in large-scale COVID-19 testing in countries with limited laboratory capacity.However, our study has some limitations.Due to a shortage of the STANDARD Q test kits, we tested a reduced number of negative samples.It would have also been desirable if we had included prospective clinical data.Further, although there were other commercially available RDTs, we only evaluated the performance of two RDTs.

Conclusion
The Panbio and STANDARD Q COVID-19 antigen tests showed excellent performance in detecting the SARS-CoV-2 infected cases and fulfilled the World Health Organization recommendations (≥ 80% sensitivity and ≥ 97% specificity compared to the RT-PCR) for the use of these tests.However, a further investigation with a larger sample size on fresh nasopharyngeal specimens collected at the point of care would be essential to confirm the observed diagnostic performance and integrate them into clinical guidelines.

Table 1 .
Demographic and clinical characteristics of study participants, Hawassa, June 2022.HIV, human immunodeficiency virus; RT-PCR, real-time polymerase chain reaction.

Table 2 .
Summary of the results of the Panbio and STANDARD Q COVID-19 antigen rapid test devices compared to the RT-PCR, Hawassa, June 2022.CI, confidence interval; RT-PCR, real-time polymerase chain reaction.

Table 3 .
11agnostic performance of the Panbio and STANDARD Q in different subgroups for RT-PCR positive participants, Hawassa, June 2022.Ag, antigen; CI, confidence interval; CT, cycle threshold; RDT, rapid diagnostic test.adults11.Although the onset of the symptom is harder to identify in children than in adults, which may influence comparison, the proportion of individuals having a CT value of ˂ 25 was higher in the 18 years and older group compared to the under-18 age group (53.5% versus 37.9%, respectively).

Table 4 .
Performance evaluation of antigen rapid diagnostic tests against RT-PCR regarding days after symptom onset, Hawassa, June 2022.CI, confidence interval.

Table 5 .
The median and interquartile range of CT values and days post symptoms onset for true positive and false negative results, Hawassa, June 2022.Ag-RDT, antigen rapid diagnostic test; CT, cycle threshold; IQR, interquartile range; RT-PCR, real-time polymerase chain reaction.